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Introduction 

This  report  discusses  problems  resolved  in  the  processing  (including  capture)  of  the    1993 
National  Census  Test  (NCT)  survey.  It  may  help  in  the  planning  and  development  of 
any  future  Census  Test,  assuming  the  methodology  of  the  Census  to  continue  as  a  self- 
completion,  mail-back  paper-and-pencU    form.  On  the  other  hand,  the  NCT  was  adapted 
to  1993  Labour-Force  Survey  (LFS)  procedures;  as  the  LFS  moves  to  CAI  (Computer- 
Assisted  Interviewing)  some  of  our  problems  may  be  unique  to  the  1993  test. 

Field  Operations   -  Background 

The  NCT  used  a  November  8, 1993  reference  date.  Questionnaire   drop-off  started  on 
Saturday  October  30  and  finished  on  Friday,  November  5, 1993. 

One  component  of  the  test  was  selection  of  a  subsample  of  NCT  households'  whose 
responses  were  captured  as  the  "Edit  FaUure  Survey"  (EFS)  component  of  die  survey  as 
soon  as  received  in  die  ROs,  then   sent  back  to  interviewers  for  field  edits  and  foUow-up. 
These  questionnaires  were  re-captured    in  order  to  test  the  field  edits  and  follow-up. 

Startup  of  data  capture  of  EFS  responses  was  delayed  a  day  or  two  because  of  the 
November  11th  holiday  (Thursday)  and  problems  encountered  with  the  capture  program 
written  in  the  DC2  software.   The  first  transmission  was  received  from  the  Edmonton 
RO  on  Saturday,  November  13,  1993.  Data  collection  was  completed  for  EFS  responses 
by  November  30,  1993.  The  raw  EFS  file  consisted  of  10,145  person-records. 

Data  capture  of  NCT  responses  started  on  December  10,1993  and  the  final  transmission 
was  received  on  January  26.  1994.  The  raw  NCT  file  (combined  LFS-based  and  special 
populations)  consisted  of  47,057  person-records. 


Print  Requirements 

Labels:  Labels  and  interviewer-assignment  control-lists  were  generated  through  the  LFS 
and  had  to  fit  in  with  the  LFS  production  facUities.  The  household  identification  code  on 


'Sample  selection  was  completed  on  the  Mainframe  by  Mike  Egan.   The  main 
sample  was  selected  as  a  subset  of  the  LFS  sample  from  April,  May  and  June  of  1991, 
which  "rotated  out"  of  (i.e., finished  with)  the  LFS  in  September  -  November  1991.  It 
was  judged  that,  two  years  after  LFS  participation,  the  households  would  not  have 
retained  any  bias  in  then:  attitudes  from  die  LFS  experience  that  would  significandy 
affect  their  NCT  responses.  A  total  of  17,109  dwellings  was  selected.    The  EFS  sample 
was  1/2  of  the  NCT  sample,  i.e., 8500  dwellings.  A  fiirdier  3985  dwellings  were  picked 
for  "special  population"  samples,  primarily  from  1991  Census  files. 


labels  and  control  lists  was  15  bytes  long,  consisting  of  the  LFS-file  fields  PSU,  GROUP, 
CLUSTER,  ROTATION,   LISTING  and  MULTIPLE.    Only  fourteen  bytes  of  identifying 
information  were  generated  in  the  label  program  instead  of  fifteen,  with  'multiple' not 
being  printed.    To  resolve  this  problem  regional  offices  were  instructed  to  code  '0'  in 
'multiple'  on  the  labels  and  control  lists.  In  spite  of  the  instructions,  'multiple'  was  still 
blank  for  many  cases  on  the  assignment  control  lists.  This   was  problematic  because  they 
were  to  be  linked  to  household-related    responses  from  the  main  questionnaire  to  create  a 
Household  file.  To  recover  the  multiple  a  match  to  the  sample  file  to  pick  up  this  field 
was  performed.    All  multiple  codes  of  1  or  higher  were  selected  and  assigned  manually 
on-line. 

All  linkage  specifications  used  a  20-byte  id  consisting  of  the  Interviewer  Assignment 
Number  (IAN),  PSU,  group,  cluster,  rotation,  listing  and  multiple.   With  hindsight,  it 
would  have  been  better  to  have  used  a  shorter  household-id  code  similar  to  the  LFS  RO- 
DOCKET.    Linking  on  a  household  identifier  of  twenty  bytes  was  long,  cumbersome  and 
error-prone. 

During  assignment  planning,  ROs  were  asked  to  assign  "7"  as  the  second  digit  of  the  IAN 
if  the  dwelling  was  picked  for  the  LFS-based  sample,  and  "9"  for  special-population 
samples^    In  general,  this  worked  and  made  it  readUy  possible  to  separate  and  order  the 
assignments  for  printing  labels  and  assignment  control  sheets.    However,  there  were  a 
few  errors  which  suggests  that  clean-ups  must  be  done  early  in  the  initial  stages  of 
processing  in  order  to  verify  the  IAN. 

Furthermore,  to  accomodate  the  L\N  planning  (R21  files)  there  needs  to  be  adequate 
lead  time  to  allocate  lANs.  These  are  allocated  by  PSU,  GROUP  and  CLUSTER  for  the 
LFS  rotate-out  sample.    We  allowed  three  months  for  the  completion  of  assignment 
planning  in  the  regional  offices. 

A  problem  arose  m  the  Special  Population  sample.    Some  EAs  exceeded  75  households 
which  was  the  maximum  allocation  for  one  assignment.    In  order  for  the  ROs  to 
determine  how  to  break  the  EA  down  into  meaningful  geographical  delineations  at  the 
household  level  the  household  id  was  carried  on  the  LOl  file.  A  hardcopy  listing  with 
address  information  was  provided  for  each  RO  to  cross  reference  with  the  household  id 
given  on  the  LOl  file.  For  EAs  that  were  too  large  for  one  assignment  '01' was  put  m 


^A  total  sample  of  3985  households  was  selected  using  1991  Census  Visitation 
Records  to  locate  EAs  with  high  concentrations  of  the  special  populations  of  interest. 
The  Winnipeg  and  Saskatoon  Metis  samples  were  obtained  from  provincial  membership 
association  lists.  These  households  were  in  addition  to  the  LFS-based  main  NCT  sample. 


the  yieldl  Fortunately,  none  of  these  procedures  had  an  impact  on  the  instruction 
manuals  written  by  Survey  Operations. 

The  Special  Population  samples  were  not  weighted  because  they  are  not  representative 
samples  of  the  population  in  general,  and  national  estimates  will  not  be  calculated  from 
the  information  obtained.    The  major  purpose  of  these  samples  is  to  evaluate  the  Census 
Test  Questionnaire   for  specific  groups*  that  may  experience  particular  problems  with  the 
proposed  questions. 

If  there  is  to  be  a  Special  Population  component  in  fumre  Census  tests  then  careful 
attention  is  required  in  the  preparation  of  the  "F03"  files  needed  by  LPS  (John  Rowland) 
as  input  to  the  "S03"print  files  needed  by  ISD  (Kathy  Reid/  Dave  Bowman).    Extra 
processing  was  required  to  reformat  Special  Population  records  into  an  "F03"strucmred 
response  file.  This  file  was  required  by  the  LPS  to  create  an  "S03"print  file  for  the 
production  of  NCT  labels  and  contirol  lists.  For  the  two  Metis  samples  selected  from 
membership  association  lists  we  had  to  make  up  dummy  Prov-FED-EA-Hhld  numbers. 
The  proper  Province  code  was  assigned,  '000000' for  FED-EA  and  then  Hhld  number 
was  sequentially  assigned  commencmg  at  '001'.  Group  and  Rotation  were  recoded  to 
zeros    The  LPS  "F03  Short"  record  length  is  280  bytes  but  the  Special  Population  mock 
F03  was  created  as  131  bytes.   The  LPS  P03  file  expects  a  record  length  of  372  so  the 
Special  Population  file  was  zero-filled  to  meet  this  requirement. 

Two  problems  arose  with  the  Special  Populations.    The  F03  interviewer  assignment 
numbers  aANs)  were  not  moved  over  correctly  and  consequentiy  did  not  match  Dave 
Bowman's  file.  This  was  resolved  in  the  program  that  merged  the  F03  and  R21 
(assignment  planning)  files.  The  LPS  system  required  a  current  IAN  as  weU  as  a 
previous  IAN  to  be  placed  on  the  F03  file  in  two  consecutive  places.    Secondly,  it  was 
decided  that  Edmonton  was  to  handle  the  assignment  planning  for  Winmpeg.    This 
complicated  the  print  fUe  preparation  so  that  Edmonton  could  print  Winmpeg's  labels  by 
requiring  a  matching  on  PSU,  Listing  number  and  last  byte  of  IAN  for  RO  16  and  RO 
17  data. 

A  few  days  were  lost  during  production  to  produce  a  print  fUe.  Some  more  fields  on  tiie 


^Yield  is  a  required  field  according  to  Labour  Force  procedures  for  updating 
assignments  in  the  ROs 

'^Blacks  in  Halifax,  Asians  in  Montireal,  Blacks  in  Monti:6al,  Latin  Americans  in 
Montreal,  Asians  in  Toronto.  Blacks  in  Toronto,  Aboriginals  in  Winnipeg,  Metis  in 
Winnipeg,  Metis  in  Saskatoon,  Aboriginals  in  Regina,  Aboriginals  in  Edmonton  and 
Asians  in  Vancouver 


372-byte  F03  were  identified  that  should  have  specific  values^  (see  footnote  below  for 
future  reference). 

Data  Capture 

The  start  of  EFS  data  capture  was  delayed  three  or  four  days  mainly  because  of  bugs  in 
the  DC2  software  being  used  for  the  NCT.  Due  to  time  constraints  Special  Surveys  did 
not  have  an  opportunity  to  review  keyer  instructions.    One  instruction  called  for 
household  data  (Steps  1  -  7  and  QQ47  onwards)  to  be  captured  only  once  as  a  part  of 
the  person-1  record.    In  several  cases,  household  data  were  captured  for  somebody  other 
than  person  1^  An  ambiguity  in  the  instructions  may  have  been  the  reason.  It  would 
have  been  desirable  to  have  reviewed  and  commented  on  the  instructions. 

In  using  DC2,  there  was  no  means  of  control  to  guarantee  all  household  members  had 
been  captured.    DC2  was  capable  of  controlling  for  the  number  of  forms  but  there  was 
no  way  of  knowmg  whether  a  key  operator  had  missed  out  an  entke  person  from  the 
form.  A  higher  level  of  verification  than  was  used  would  be  helpful. 

The  design  of  the  questionnaure  was  set  up  for  vertical  capture  to  reflect  the  capturing  of 
person  records  within  the  household.    No  colour  distinction  was  made  on  the  form  to 
assist  the  key  operator  visually  to  stay  in  the  correct  column  on  each  page.   A 
recommendation   for  shading  should  be  made  if  the  budget  can  handle  the  additional  cost 
for  printing. 

Another  limitation  of  the  DC2  software  was  that  it  lacked  verification  flexibUity.  For 
example,  100%  of  a  given  field  had  to  be  verified  by  re-keying  for  all  forms.  It  was  not 
possible  to  verify  a  sample  of  forms.  It  would  have  been  preferable  to  have  taken  a 
subsample  of  documents  and  verified  on  several  or  all  fields.  If  this  option  had  been 
avaUable  a  better  picture  of  the  error  rate  incurred  by  the  key  operator  would  have  been 
evident.  For  budget  reasons  we  chose  to  verify  the  20-byte  Household  identifier  and 
questions  2-5  for  every  form.    We  would  advise  with  hindsight  a  higher  level  of 
verification. 

Processing 


^  survey  id  (pos.25,1)  =  1 

preprinted  code  (pos.52,l)  =  l  (=0  if  special  populations) 

pos.  54,8  =  blank  (flags  based  on  a  previous  month  -  make  special  populations  look 

like  births) 

pos.  280,1  =  0  (there  are  no  notes) 

pos.  266  =  1  (if  flagged  for  EFS  or  blank  on  special  populations) 

^This  occured  primarily  in  the  Montreal  RO. 
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Since  a  major  purpose  of  the  test  was  to  measure  errors,  the  capture  program  was 
written  and  costed  to  allow  for  multiple  entries  for  all  precoded  questions,  mcludmg 
those  with  instructions  "mark  one  only".  It  is  questionable   whether    subject  matter 
people  were  interested  enough  in  multiple-response   errors  to  make  this  worth  while. 
Developing  and  testing  the  data  capture  entry  system  took  many  person-days  more  than 
if  Special  Surveys'  standard  processing  practice  had  been  used,  of  capturing  the  first 
response  where  only  one  is  expected.    Future  tests  might  also  use  RO  facilities  for 
grooming  before  capture. 

A  shortage  of  resources  during  the  processing  was  experienced.    Planners  and  managers 
of  any  future  Census  test  will  want  to  be  assured  of  having  adequate,  qualified 
programmers  to  handle  complex  programmmg  requirements^    To  complete  the  testmg 
and  production  runs  for  the  NCT  three  experienced  programmers  were  found  at  short 
notice  in  January  1994,  each  available  for  a  few  weeks  only.  Each  programmer  was 
assigned  his  own  tasks.   What  was  being  tested  or  produced  and  by  whom  requured  hour- 
to-hour  attention  and  direction  from  a  coordinator^. 

Attention  needs  to  be  paid  to  the  creation  and  availabUity  of  detailed  test  files.  During 
the  phase  of  program  development  for  derived  variables  programmers  wanted  good  test 
files    Because  of  the  namre  of  the  DVs  these  test  files  are  best  supplied  by  subject 
matter  persons  who  are  responsible  for  specifications  for  the  DVs.  Early  advisement 
should  be  given  to  subject  matter  in  order  that  they  can  prepare  for  this  part  of  the 
processing. 

Working  on  the  same  platform  would  have  been  advantageous  in  terms  of  location  and 
management  of  file  creation.    For  example,  all  of  the  processing  could  have  been 
handled  on  our  own  LAN,  or  on  the  Census  LAN  (UNDC)  or  on  the  Mainframe.    In 
acmality  there  was  a  lot  of  uploading  and  downloading  of  production  files  m  order  to 
accomodate  the  two  working  environments  used  for  the  1993  NCT'.  From  the  creation 
of  the  RAW  files  to  the  PREDIT  files  the  processing  was  handled  on  the  Mainfirame. 
Afterwards  the  processing  was  all  done  on  the  UNIX,  except  for  one  of  the  short-term 
borrowed  programmers  who  preferred  to  work  on  the  mainframe.    At  times  the  Unix 
was  a  bit  slow  due  to  maximum  user  capacity  or  space  limitations.   Presumably  there  are 
cost  savings  in  using  a  LAN  such  as  the  Census  Unix,  although  it  might  be  difficult  to 
determine  just  how  much. 


■'The  NCT  Operational  team  in  Special  Surveys  consisted  of  Phil  Stevens  -Manager, 
Neelam  Prakash  -  Programmer  (replacement   for  Mike  Egan  in  September,   1993),  and 
Lorie  Shinder  -  Processing  Rep. 

^Evelyn  Ryan  of  Census  Operations  contiroUed  and  monitored  the  assignment  of  tasks 
of  the  three  programmers. 

'Processing  was  developed  and  run  on  both  the  Mainframe  as   well  as  the  UNIX. 
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Other  than  for  income  data  (Q.46  in  the  test)  there  was  no  editing  of  results  by  Special 
Surveys  after  capUire.    For  futtire  tests,  from  a  capmre  point  of  view,  consideration 
should  be  given  to  omitting  the  income-question  cents  boxes,  or  to  retaining  the 
background  colour  in  them  (i.e., not  dropping  them  out).    They  added  to  the  incidence  of 
error  despite  key  operators  being  instructed  not  to  capmre  the  cents.    Perhaps  mcome- 
question  mstructions  could  be  tested:  "enter  the  amount  to  the  nearest  doUar".  If  future 
tests  include  editing  the  income  data,  verification  on  this  field  should  be  mcluded,  and 
there  should  be  more  edits  included  in  the  capmre  system.   About  four  programmer- 
weeks  were  used  in  the  test  just  to  edit  Q46  which  became  an  expensive  and  time- 
consuming  aspect  of  overall  programming. 

To  satisfy  LFS  weight-correction  procedures,  every  record  in  the  main  LFS-sample-based 
results  file  had  to  have  an  age  value.   Year  of  buth  was  imputed  where  missing,  then  age 
derived  from  it.  Age  was  then  copied  to  the  EPS  file.    The  EFS  sample  was  a  subset  of 
the  NCT  LFS-based  .sample,  with  data  for  each  person  captured  twice  -  once  before  field 
edits  and  follow-up  in  the  EFS  file,  then  after  edits  and  follow-up  in  the  NCT  file. 
However,  some  records  in  the  EFS  file  were  not  captured  in  the  main  NCT  file,  because 
not  returned  in  tune  for  NCT  capture,  or  lost  in  the  maU.  In  the  step  of  copying  age  to 
the  EFS  file  from  the  NCT  file,  an  "unknown"  value  was  given  to  EFS  records  not  m  the 
NCT  file.  Some  of  these  EFS  records  nevertheless  had  valid  year-of-birth  data.    It  might 
have  been  desirable  to  allow  for  separate  derivation  of  age  for  these  records.    If  fumre 
tests  follow  the  same  methodology  for  an  EFS  component,  this  step  should  be  taken  mto 
consideration. 

A  detailed  plan  of  processing  steps  needs  to  be  drafted  as  well  as  documented  to  provide 
an  overview  of  the  tasks  at  hand  and  in  the  proper  sequence.      For  example,  after  the 
creation  of  many  of  the  derived  variables  the  NCT  team  became  aware  that  the 
temporary  and  foreign  residents  (i.e., those  checking  Step  4  or  Step  6  of  the 
questionnaire)    should  have  been  dropped  firom  the  NCT  and  EFS  files  at  earlier  stages 
of  processing,  when  duplicate  and  empty  records  were  dropped.    This  also  unpacted  on 
the  coding  because  the  write-ins  had  been  split  off  and  sent  for  coding  before  temporary 
and  foreign  residents  were  dropped.    At  the  time  of  code  linkage  we  had  more  codes 
than  we  could  initially  account  for,  until  we  recalled  that  the  extras  were  from  the^^ 
dropped  temporary  and  foreign  residents.    Up-to-date  documentation   is  important  . 

Autocoding 

An  unanticipated   component  was  the  request  by  subject  matter  to  allow  for  more  than 
one  code  to  be  returned  for  a  multiple  response.    One  characteristic  of  the  ACTR  system 
is  that  it  can  only  provide  one  code  per  write-in.  Multiple  responses  for  Ethnic  ongm 


^"Attached  are  the  NCT  and  EFS  processing  flowcharts. 
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(Q16)  and  Language  (Q09  and  Qll)  were  resolved  manually  by  subject  matter.    Using 
SAS,  Special  Surveys  produced  hardcopy  to  assist  with  the  manual  resolution.    It 
contained  additional  information  from  other  questions  for  die  respondent   as  well  as 
write-ins  from  other  members  of  the  household. 

It  would  be  helpful  if  Subject  Matter  people  were  to  decide  in  advance  if  they  wanted  to 
include  more  than  one  code  from  write-ins.  and  if  so  the  maximum  number  of  entries, 
and  how  to  handle  situations  which  exceed  that  limit.  In  addition,  they  could  specify 
their  requirements  for  additional  information  to  aid  coding  early  in  the  planning  for 
coding  and  whether  or  not  a  hardcopy  or  machine  readable  format  is  acceptable. 

Resolution  of  multiple  response  might  be  handled  better  by  assigning  a  unique  code  for  a 
given  multiple  during  initial  coding  and  then  resolving  these  codes  after  the  linkage 
processing.    The  reasons  would  be  twofold:   first.  Special  Surveys  could  accurately  verify 
code  linkage  back  to  the  NCT  and  EFS  files  and  second.  Subject  Matter  would  have  an 
opportunity  to  look  at  all  codes  before  deciding  the  appropriate   course  of  action  (e.g., 
whether  to  recode  to  more  than  one  code  or  not). 

The  multiple  response  problem  will  contmue  to  be  problematic  with  the  use  of  open- 
ended  questions.    If  this  style  of  questioning  is  used  for  the  1996  Census  or  the  next  NCT 
further  system  development  wUl  be  required  to  handle  the  resolution  of  these  cases. 


APPENDIX 


Processing  Flow 
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RFS     DATAFLOW 


UNK  PROCESSING 


EFSRAWFILE 


EFS  BRANCH 


STEP  01: 


SAS  PROGRAM:  CAPS/COO/PROO/EFS/VLOPID.PGH 

SAS  LOG:  CAPS/COD/PROO/EFS/VLDPID.LOG 

SAS  OUTPUT:  CAPS/COO/PROO/EFS/VLOPID.OUT 

SAS  CARD(S): 

INPUT  FILE(S):  CAPS/C00/PR00/EFS/RAW1728. COMPLETE. DAT. OO.DECOI 

OUTPUT  FILE(S):  CAPS/COO/PROO/EFS/VLDPID. RAW1728.DAT. 10. DEC10 


<10,U5) 
(10,090) 


STEP  02: 


SAS  PROGRAM: 
SAS  LOG: 
SAS  OUTPUT: 
SAS  CARD(S): 
INPUT  FILE(S): 
OUTPUT  FILE(S) 


CAPS/COO/PROO/EFS/RAWNDU . PGM 
CAPS/COD/PROO/E  FS/RAWNDU . LOG 
CAPS/COO/PROD/E  FS/RAWNDU .OUT 

CAPS/COO/PROO/EFS/VLDPID. RAW1728.DAT.10.DEC10 
CAPS/COD/PROO/EFS/RAWNDU. RAW1728.DAT. 11. MARIO 


(10,090) 
(10,087) 


STEP  03: 


SAS  PROGRAM:  CAPS/C00/PR00/EFS/N0NTEMP2.PGM 

SAS  LOG:  CAPS/C00/PR00/EFS/N0NTEMP2.L0G 

SAS  OUTPUT:  CAPS/C00/PR00/EFS/N0NTEMP2.0UT 

SAS  CARD(S): 

INPUT  FILE(S):  CAPS/COO/PROD/E FS/RAWNDU. RAW1728.DAT. 11, MAR 10 

OUTPUT  FILE(S):  CAPS/COO/PROO/EFS/NONTEMP. RAW1728.DAT. 03.MAR16 


(10,090) 
(10,087) 


EFS  BRANCH 

MAINFRAME  PROCESSING: 


FIRST  PROGRAM  (STEP  1):  SPEC.ICT9311.SRCE(S0RT) 

INPUT  FILE(S):  SPEC.ICT9311.RAWPH1.ESSDEC01 

OUTPUT  FILE(S):  SPEC. ICT9311.RAWPH1.ESSDEC01. SORTED 
Irecl:  1728,  blksize:8640 

(STEP  2):  SPEC.ICT9311.SRCE(DUPSEQ2) 


#  RECORDS:  10,145 

#  RECORDS:  10,145 
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INPUT  FILE(S):   SPEC.  1CT931 1  .RAWPH1  .ESSDEC01  .SORTED 

OUTPUT  FILE(S):   SPEC.ICT9311 -RAWPHl .DUPS 

•  SPEC. ICT9311. RAWPHl. UNIQUE 
Irecl:  1728,  blksize:8M0 


#  RECORDS:   10,145 

#  RECORDS:  0 

#  RECORDS:   10,145 


(Program  is  checking  &  producing  output  file  with  duplicate  records) 


SECOWD  PROGRAH:  SPEC.ICT9311.SRCE<FSPLIT) 

INPUT  FILE(S):  SPEC. ICT9311. RAWPHl. ESS0EC01  * 

*  DOUMLOADED  TO  UMIX:  /PR0D/EFS/RAU1728.C0MPLETE.DAT.00.DEC01 

OUTPUT  FILE(S):   SPEC.ICT9311.RAWESS.PERSI000 

:  SPEC.ICT9311.RAWESS.VLDPERID  * 
Irecl:  1728,  blksize:8640 

*  DOUHLOADED  TO  UMIX:  /PROO/EFS/VU)PID.RAU1728.DAT.01.DEC10 

(Program  is  spliting  records  with  PERSONID  =  '00'  ) 


#  RECORDS:  10,145 


#  RECORDS:  55 

#  RECORDS:   10,090 


PREDIT  PROGRAH:  FINAL  FILE  BEFORE  601MG  INTO  PREDIT 

THIRD  PROGRAH:  SPEC-ICT9311.SRCE<C0HPEDIT) 

INPUT  FILE(S):  SPEC.ICT9311.RAWESS.VL0PERI0 

OUTPUT  FILE(S):  SPEC.ICTVSII.EFS.PREDIT.MONTEXT 
Irecl  =  92,  blksize  =  8832 

:  SPEC.ICT9311.EFS.PREDIT.TEXT 
Irecl  =  532,  blksize  =  8512 

(PL1  program  is  going  through  the  PREDIT  step  and  creating  2  output  files; 
(1>...TEXT  file,  Irecl  =92,  blksize  =  8832 
(2)... NON-TEXT  file,  Irecl  =  532,  blksize  =  8512 


#  RECORDS:   10,090 

#  RECORDS:  10,090 

#  RECORDS:   9,551 


FILE   BEINfl  PREPARFD   FOR  AUTOCXJDING: 


giBSEQUEIIT  PRnratAMfSI  TO  CgF«TI=  TEXT  FILES  FOR  AUTOCODIMG 

PPnratAH  1:     SPECirtOTH -SRCECALLTEXT) 

INPUT  FILE(S):  SPEC. ICT9311. RAWPHl. ESSDEC01 
LRECL:  1728,  blksize  =  8640 

OUTPUT  FILE(S):  SPEC.ICT9311.PF.RAWPH1.ALLTEXT 
LRECL:  794,  blsize  =  8734 


#  RECORDS:  10,145 

#  RECORDS:  10,145 


(Program  is  picking  up  all  fields  where  text  is  and  producing  1  big  text  file  of  794  bytes  which  will  be 
split  in  subsequent  program) 


PROGRAH  2  :  SPEC.ICT9311-SRCE(SMALLTXT) 

STEP  A'  SORT 

INPUT  FILE:  SPEC.ICT9311.PF.RAWPH1.ALLTEXT 

LRECL:  794 


#  RECORDS:  10,145 
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72-BYTE  OUTPUT  FILE(S): 


SPEC 

SPEC 

SPEC. 

SPEC 

SPEC 

SPEC 

SPEC 

SPEC 

SPEC 

SPEC 

SPEC 

SPEC 

SPEC 

SPEC 

SPEC 


ICT9311 
ICT9311 
ICT9311 
ICT9311 
ICT9311 
ICT9311 
ICT9311 
ICT9311 
ICT9311 
ICT9311 
ICT9311 
ICT9311 
ICT9311 
ICT9311 
ICT9311 


.PF.RAWPHI 
.PF.RAUPH1 
.PF.RAWPH1 
.PF.RAWPHI 
.PF.RAWPHI 
.PF.RAWPHI 
.PF.RAWPHI 
.PF.RAWPHI 
.PF.RAWPHI 
.PF.RAWPHI 
.PF.RAWPHI 
.PF.RAWPHI 
.PF.RAWPHI 
.PF.RAWPHI 
.PF.RAWPHI 


.Q09TX1 

.Q09TX2 

.Q09TX3 

.Q11TXT 

.Q12TXT 

.Q13TXT 

.Q16TXT 

.Q18TX1 

.Q16TX2 

.Q16TX3 

.Q19TXT 

.Q24TXT 

.Q41TXT 

.Q22TXT0C 

.Q22TXTIC 


97- BYTE  OUTPUT  FILE: 
SPEC.ICT9311.PF.RAWPH1.Q22TXTIC 


163 -BYTE  OUTPUT  FILE: 
SPEC.ICT9311.PF. RAWPH 1 . Q42TXT 

#  RECORDS  ON  EACH  OUTPUT  FILE:   10, U5 


NOTE:   Each  of  the  above  files  created,  is  split  into  two  files 
non-blank  &  blanks;   non-blanks  are  sent  for  autocoding. 


STEP  B1:  SPLIT  FOR  Q09  TEXT  1  (OlOULEDffi  OF  LANGUAffi) 

INPUT  FILE(S):  SPEC.ICT9311.PF.RAWPH1.Q09TX1 
LRECL:  72,  BLKSIZE:  8856 

OUTPUT  FILE(S):  SPEC.ICT9311.PF.RAWPH1.Q09TX1.M0NBLK  * 
LRECL:  72 
•  FILE  SENT  FOR  AUTOCODING 

:  SPEC. ICT9311 .RAWPH1 .Q09TX1 .BLANKS 


#  RECORDS:  10,145 


#  RECORDS:  902 


#  RECORDS:  9,243 


STEP  82:  SPLIT  FOR  Q09  TEXT  2  (KNOULEDGE  OF  LANGUAGE) 
INPUT  FILE(S):  SPEC.ICT9311.PF.RAWPH1.009TX2 
LRECL:  72 

:  SPEC.ICT9311.PF.RAUPH1.Q09TX2.NONBLIC  * 

LRECL:  72 
•  FILE  SENT  FOR  AUTOCODING 

:  SPEC. ICT9311.RAWPH1.Q09TX2. BLANKS 


#   RECORDS:  10,145 


#  RECORDS:  102 


#  RECORDS:  10,043 


STEP  83:  SPLIT  FOR  Q09  TEXT  3  (KNOWLEDGE  OF  LANGUAGE) 

INPUT  FILE(S):  SPEC. ICT9311 .PF.RAWPHI .Q09TX3 
LRECL:  72 


«   RECORDS:  10,145 
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:   SPEC.ICT9311.PF.RAWPH1.Q09TX3.HONBLK  * 

LRECL:  72 
*  FILE  SENT  FOR  AUTOCOOING 

:  SPEC . I CT93 1 1 . RAWPH 1 . Q09TX3 . BLANKS 


#  RECORDS:  24 


#  RECORDS:  10,121 


STEP  C:   SPLIT  FOR  Q11  TEXT  {MOTHER  TONGUE) 

INPUT  FILE(S):  SPEC.ICT9311 .PF.RAWPH1 .Q11TXT 
LRECL:  72 

OUTPUT  FILE(S):  SPEC.ICTSSII.PF.RAWPHI.QllTXT.MONBLIC  * 
LRECL :  72 
*  FILE  SENT  FOR  AUTOCOOING 

:  SPEC. ICT9311.RAWPH1.Q11TXT. BLANKS 


#  RECORDS:   10,145 


#  RECORDS:  883 


#  RECORDS:  9,262 


STEP  D:  SPLIT  FOR  Q12  TEXT  (PLACE  OF  BIRTH) 

INPUT  FILE(S):  SPEC.ICT9311.PF.RAWPH1.Q12TXT 
LRECL:  72 

OUTPUT  FILE(S):  SPEC.ICT9311.PF.RAUPH1.Q12T)(T.NOHBLIC  * 
LRECL:  72 
*  FILE  SENT  FOR  AUTOCOOING 

:  SPEC. ICT9311.RAWPH1.Q12TXT. BLANKS 


#  RECORDS:  10,145 

#  RECORDS:  950 

#  RECORDS:  9,195 


STEP  E:  SPLIT  FOR  Q13  TEXT  (CITIZENSHIP) 
INPUT  FILECS):  SPEC.ICT9311.PF.RAWPH1.Q13TXT 
LRECL:  72 

OUTPUT  FILE(S):  SPEC.ICT9311.PF.RAWPH1.Q13TXT.N0NBLIC  * 
LRECL :  72 
•  FILE  SENT  FOR  AUTOCOOING 

:  SPEC. ICT9311.RAWPH1.Q13TXT. BLANKS 


#  RECORDS:  10,145 

#  RECORDS:  299 

#  RECORDS:  9,846 


STEP  F1:  SPLIT  FOR  Q16  TEXT  1  (ETHNIC  ORIGIN) 
INPUT  FILE(S):  SPEC.ICT9311.PF.RAWPH1.Q16TX1 
LRECL:  72 

OUTPUT  FILE<S):  SPEC.ICT9311.PF.RAUPH1.Q16TX1.N0NBLIC  * 
LRECL:  72 
•  FILE  SENT  FOR  AUTOCOOING 

:  SPEC. ICT931 1 .RAWPH1 .Q16TX1 .BLANKS 


#  RECORDS:  10,145 


#  RECORDS:  8,838 


#  RECORDS:  1,307 


STEP  F2:  SPLIT  FOR  016  TEXT  2  (ETHNIC  ORIGIN) 

INPUT  FILE(S):  SPEC.ICT9311.PF.RAWPH1.Q16TX2 
LRECL:  72 

OUTPUT  FILE(S):  SPEC.ICT9311.PF.RAUPH1.Q16TX2.N0NBLK  * 
LRECL:  72 
•  FILE  SENT  FOR  AUTOCOOING 

:  SPEC. ICT9311.RAUPH1.Q16TX2. BLANKS 


#  RECORDS:  10,145 

#  RECORDS:  3,262 

#  RECORDS:  6,883 
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STEP  F3:  SPLIT  FOR  016  TEXT  3  (ETHMIC  ORIGIM) 

INPUT  FILE(S):  SPEC.ICT9311.PF.RAWPH1.Q16TX3 
LRECL:  72 


OUTPUT  FILE(S):  SPEC.ICT9311.PF.RAUPH1.Q16TX3.N0HBLIC 
LRECL:  72 
*  FILE  SENT  FOR  AUTOCOOING 

:  SPEC.ICT9311.RAWPH1.Q16TX3. BLANKS 


#  RECORDS:      10,  K5 

#  RECORDS:      1,334 

#  RECORDS:      8,811 


STEP  G:  SPLIT  FOR  018  TEXT  (RACE) 

INPUT  FILE(S):  SPEC.ICT9311.PF.RAWPH1.Q18TXT 
LRECL:  72 

OUTPUT  FILE(S):  SPEC.ICT9311.PF.RAUPH1.018TXT.N0NBLIC 
LRECL:  72 
•  FILE  SENT  FOR  AUTOCOOING 

:  SPEC. ICT9311.RAWPH1.Q18TXT. BLANKS 


#  RECORDS:  10,145 


#  RECORDS:  98 


#  RECORDS:  10,047 


STEP  H:  SPLIT  FOR  019  TEXT  (INDIAN  BAND) 

INPUT  FILE(S):  SPEC.ICT9311.PF.RAUPH1.Q19TXT 
LRECL:  72 

OUTPUT  FILE(S):  SPEC.ICT9311.PF.RAUPH1.019TXT.N0NBLK 
LRECL:  72 
•  FILE  SENT  FOR  AUTOCCDING 


SPEC.ICT9311.RAWPH1.019TXT.BLANKS 


#  RECORDS:  10,145 

#  RECORDS:  46 

#  RECORDS:  10,099 


STEP  I:  SPLIT  FOR  024  TEXT  (LANGUAGE  OF  EDUCATION) 
INPUT  FILE(S):  SPEC.ICT9311.PF.RAWPH1.Q24TXT 
LRECL:  72 

OUTPUT  FILE(S):  SPEC.ICT9311.PF.RAUPH1.024TXT,N0NBLK  * 
LRECL:  72 
•  FILE  SENT  FOR  AUTOCOOING 

:  SPEC. ICT931 1 .RAWPH1 .Q24TXT .BLANKS 


#  RECORDS:  10,145 


#  RECORDS:  59 


#  RECORDS:  10,086 


STEP  J:  SPLIT  FOR  041  TEXT  (LANGUAGE  OF  WORK) 

INPUT  FILE(S):  SPEC.ICT9311.PF.RAWPH1.Q41TXT 
LRECL:  72 

OUTPUT  FILE(S):  SPEC.ICT9311.PF.RAUPH1.041TXT.N0NBLK  * 
LRECL:  72 
•  FILE  SENT  FOR  AUTOCOOING 

:  SPEC. ICT9311.RAWPH1.Q41TXT. BLANKS 


#  RECORDS:  10,145 


#  RECORDS:  78 


#  RECORDS:  10,067 
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STEP  K:  SPLIT  FOR  Q22  TEXT  <HOBILITY  OUTSIDE  CANADA) 

INPUT  FILE(S):  SPEC.ICT9311.PF.RAWPH1.Q22TXT0C 
LRECL:  72 

OUTPUT  FILE(S):   SPEC.ICT9311.PF.RAUPH1.Q22TXTOC.NOHBUC  * 
LRECL:  72 
*  FILE  SENT  FOR  AUTOCODING 

:  SPEC . I CT931 1 . RAWPH 1 . Q22TXTOC . BLANKS 


#  RECORDS:  10,145 

#  RECORDS:   179 

#  RECORDS:  9,966 


STEP  L:  SPLIT  FOR  Q22  TEXT  (NOBILITY  INSIDE  CANADA) 

INPUT  FILE(S):  SPEC.ICT9311.PF.RAWPH1.Q22TXTIC 
LRECL:  97 

OUTPUT  FILE(S):  SPEC.ICT9311.PF.RAUPH1.Q22TXTIC.N0NBLIC  * 
LRECL:  97 
«  FILE  SENT  FOR  AUTOCODING 

:  SPEC. ICT9311.RAWPH1.Q22TXTIC. BLANKS 


#  RECORDS:  10,145 


#  RECORDS:  1,540 


#  RECORDS:  8,605 


STEP  M:  SPLIT  FOR  Q42  TEXT  {PLACE  OF  UORK) 

INPUT  FILE(S):  SPEC.ICT9311.PF.RAWPH1.Q42TXT 
LRECL:  97 

OUTPUT  FILE(S):  SPEC.ICT9311.PF.RAgPH1.Q42TXT.N0NBLIC 
LRECL:  163 
•  FILE  SENT  FOR  AUTOCODING  BUT 

DUE  TO  SHORTAGE  OF  RESOURCES  PLACE  OF  WORK  UNIT 
UAS  UNABLE  TO  PERFORM  HANUAL/INTERACTIVE  COOING 


:  SPEC. ICT9311 .RAWPH1 .Q42TXT. BLANKS 


#  RECORDS:  10,145 


#   RECORDS:  4,058 


#   RECORDS:  6,087 


MAINFRAME  FILES  RETURNED  FROH  AUTOCODING; 

SPEC.ICT9311.NCTAC.LANQ09.FINAL.ESS  --  1,028  records 
SPEC.ICT9311.NCTAC.LANQ11,FINAL.ESS  —  883  records 
SPEC.ICT9311.NCTAC.PCTQ12.FINAL.ESS  —  950  records 
SPEC. ICT9311.NCTAC.PCTQ13. FINAL. ESS  —  299  records 

SPEC. ICT9311.ET0Q16. FINAL. ESS  13,434  records 

SPEC.ICT9311.ET0Q18.FINAL.ESS  98  records 

SPEC. ICT9311.INDQ19. FINAL. ESS  46  records 

SPEC.ICT9311.M5PQ22T1.FINAL.ESS  1,540  records 

SPEC. ICT9311.M5PQ22T2.FINAL. ESS  179  records 

SPEC.ICT9311.LANQ24.FINAL.ESS  59  records 

SPEC. ICT9311.LANQ41. FINAL. ESS  78  records 


UNIX    PROCESSING   FOR   EFS   AFTER   PREDIT 
"SPEC. ICT9311 -EFS.PREDIT.NOHTEXT" 

DOWNLOADED  TO  UNIX 
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"CAPS/C00/OLDPR(]0/EFS/EXCLQ46.DAT .  FEB01 " 


TTNIXPROCKSSTNG  (in  SAS> 

EFS    FLOW  OF  FILES  AFTER  PREPIT 


INPUT:   ../../OLOPROD/EFS/PREDIT. EXCLQ46.DAT. FEB01  (10,087) 


Pqm  Finction; 

linking  codes  received 
from  auto-coding  including 
ethnic  and  language  manual 
resolution. 


CODLNK.PGM 
C00LNK.LOG 
COOLNK.OUT 


OUTPUT:   ../../PROO/EFS/CODLNK.DVS953.DAT.00.MAR02  (10,087) 


INPUT:    ../../PROO/EFS/COOLNK. DVS953.DAT. 00. MAR02  (10,087) 


Pqm  function: 
eliminating  Personid  >01 
that  were  temporary 
residents  and  missed 
in  the  earlier  stages. 


NONTEMP.PGM 
N0NTEMP.LOG 
NONTEMP.OUT 


OUTPUT:  ../../PROD/EFS/NONTEMP.DVS953.DAT.01.HAR16  (9,986) 


INPUT:   ../../PROO/EFS/NONTEMP.DVS953.DAT.01.MAR16  (9.986) 


Pqm  Function: 

Fixing  046( income  question) 
Program  written  by  Amir  Ranjbar 
and  also  establishing  Multiple 
Error  Flags  for  all  questions 
that  had  multiple  responses. 


QA6MEF.PGM.HAR18 
Q46HEF.LOG. MARIS 
Q46MEF. OUT. MARIS 


OUTPUT:   ../../PROO/EFS/Q46MEF.DVS953.DAT.02.MAR18  (9,986) 


INPUT:   ../../PR00/EFS/QA6MEF.0VS953.0AT. 02. MARIS  (9,986) 

+ 
../../PROO/NCT/DVLANG. DVS953.DAT. 02. FEB28  (40,915) 


Pqm  FiJiction: 
Loading  date  of  birth,  sex 
DVAGE2  from  NCT  to  EFS  when 
they  are  blank,  for  they 
were  imputed  on  the  NCT  file. 


j  LNKBIR. PGM. MARIS 
j  LNKBIR. LOG. MARIS 
I     LNKBIR. OUT. MARIS 
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V 
OUTPUT:   ../../PRO0/EFS/LNKBIR.DVS953.DAT.03.MAR18  (40,662) 


./. ./PROO/EFS/LNKBIR.DVS953.DAT.03.MAR18  (9.986) 


P<»n  Function: 

Creating  derived  variables 
for  language  questions. 


DVLANG.PGM.MAR18 
DVLANG.LOG. MARIS 
DVLANG.0UT.MAR18 


./../PR00/EFS/DVLANG.DVS953.0AT.04.MAR18  (9,986) 


~~..l. ./PRO0/EFS/DVLANG.DVS953.DAT.04.MAR18  (9,986) 

''Tec^ng'Assignment  #  for     i  ASSPSU.PGM.MAR21 
certain  Rotation  Group  and    |  ASSPSU.L0G.MAR21 
recoding  PSU  #  "35087"       j  ASSPSU.0UT.MAR21 
instead  of  "85087"  if        j 
Rotation  Group='0'  i 

V 
../../PROO/EFS/ASSPSU.DVS953.DAT.05.MAR18  (9.986) 


~T./../PROO/EFS/ASSPSU.DVS953.0AT.05.MAR18  (9,986) 

Pqp.  Function:  j   ^3po,cE.PGM.MAR30 

LBFORCE.LOG.MAR30 
I   LBFORCE.OUT.MAR30 
V 
/  ./PRC»/EFS/LBFRCEDVS.DVS953.DAT.06.HAR28  (9.986) 


~./. ./PROO/EFS/LBFRCEDVS.OVS953.DAT.06.MAR28  (9,986) 
P«yn  Fuiction:        j  ^  ^.^^  produced  by  Norm  Crampton  on  mainframe,  to  create  ethnic  DVs) 

V 

. ./. ./PRO0/EFS/ETHDVS.DVS953.DAT.07.APR25  (9,986) 


~./. ./PROD/EFS/ETHDVS.DVS953.DAT.07.APR25  (9,986) 

Picking  Q46AAmt  from  the  raw   i   FIXQ46.PGM.MAY06 
file  (length  20  bytes),  for    !   FIXQ46.LOG.MAY06 
in  the  Predit  only  19  bytes  of  j   FIXQ46.0UT.MAY06 
Q46AAmt  were  picked  up  and  the  | 
20th  byte  was  garbage(just  for  | 
Q46AAHT)  then  ran  Q46HEF.PGM   ', 
again,  against  it.  I 

. ./. ./PRO0/EFS/FIXQ46.DVS953.0AT.08.MAY06  (9.986) 
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T./. ./PROD/EFS/FIXQ46. 0VS953.DAT. 08. MAY06  (9,986) 


Pqm  Fmction: 

Reruning  Q46MEF.PGM 

for  Q46AAmt  only  and  for 

related  multiple  flags. 


Q46MEF.REV.PGM 
Q46MEF.REV.LOG 
Q46HEF.REV.0UT 


./. ./PROD/EFS/QA6MEF.DVS953.DAT.09.MAY06  (9,986) 
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./. ./PROO/EFS/Q46MEF.DVS953.DAT.09.HAY06  (9,986) 


I 
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Pqm  FtMiction:  i 

Creating  income  derived  |  INCOME. PGM. MAY11 
variables:  wages,  investment  j  INCOME. LOG. MAY11 
Uic  etc  I    INCOME. OUT. MAY 11 

V 
../../PRO0/EFS/INCOME.DVS953.0AT.10.MAY11  (9.986) 


"~:./../PROD/EFS/INCOME.DVS953.DAT.10.MAY11  (9,986) 

Pan  Function:  ! 

Fixing  language  OVs  and  adding  j  FIX.DVLANG.PGH 
the  AGEGP  and  SEX  variables  1  FIX.DVLANG.LOG 
and  making  sure  SEXFLG  has  blanks  j  FIX.DVLANG.OUT 
instead  of  '.'  (fixed  by  Phil)    | 

V 
../../PR00/EFS/REVDVLANG.DVS953.DAT.11.MAY11  (9,986) 


~:./../PR00/EFS/REVDVLANG.DVS953.DAT.11.MAYl1  (9,986) 
I 

Pan  Function:       1  HLDSIZE.PGM 

receding  HLDSIZE     |  HLDSIZE.LOG 

from  '1'  '2'  etc.  v  HLDSIZE.OUT 

to  '01'  '02'  etc., 
WAGES  &  TOT INC 

../../PR00/EFS/HLDSIZE.DVS953.0AT.12.MAY13  (9,986) 

HOVED  TO 
../../0LDPR00/EFS/HLDSIZE.DVS953.DAT.12.MAY13.Z  (9,986) 

RENAMED  TO 
. ./.  ./PR0O/EFS/IHCOME.DVS953.DAT.08.APR05  (9,986) 

UPLOADED  TO 
SPEC.ICT9311.EFS.APR14.PUBREAD  (9,986) 


j   ../../PROO/EFS/INCOME. DVS953.DAT. 08. APR05  (9,986) 

I  > 
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Pqm  Function: 

revised  DV's  of  !            SAN0RA.DVCHECK.LOG 

Sandra  Swain  v            SANDRA. DVCHECK. OUT 
written  by  Phil 


../../PROO/EFS/DV. REVISED. DAT. 13. MAY20  (9,986) 

HOVED  TO 

../../OLDPROO/EFS/DV. REVISED. DAT. 13. MAY20  (9,986) 

RENAMED  TO 
. ./.  ./PR(]0/EFS/IM(X)ME.DVS953.0AT.08.APR05  (9.986) 

UPLOADED  TO 
SPEC.ICT9311.EFS.APR14.PUBREAD  (9,986) 


20 
SANDRA. DVCHECK. PGM 


NCT     DATAFLOW 
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UNK  PROCESSING 


NCTRAWFDLE 


NCT  BRANCH 


STEP  01: 


SAS  PROGRAM:  CAPS/COO/PROO/EFS/VLDPID.PGM 
SAS  LOG:  CAPS/COO/PROO/EFS/VLDPID.LOG 
SAS  OUTPUT:     CAPS/COO/PROD/EFS/VLDPIO.OUT 

SAS  CARD(S)' 

INPUT  FILE(S>:  CAPS/C00/PR00/EFS/RAU1728. COMPLETE.DAT. 00. JAN26 

OUTPUT  FILE(S):  CAPS/COO/PROD/EFS/RAW1728.VLDPID.DAT.00.FEB10 


(47,057) 
(40.917) 


STEP  02: 


SAS  PROGRAM:  CAPS/COO/PROD/EFS/RAUHTEMP.PGH 

SAS  LOG:  CAPS/COO/PROO/EFS/RAWNTEMP.LOG 

SAS  OUTPUT:  CAPS/COO/PROO/EFS/RAWNTEMP.OUT 

SAS  CARD(S)" 

INPUT  FILE(S):  (aiPS/C00/PR00/EFS/RAW1728. VLDPID.DAT. 00. FEB10 

+ 

:  CAPS/C00/PR00/EFS/RAW1728. COMPLETE.DAT. 00. JAN26 


I 
I 

UPLOADED 'to  MAINFRAME 
I 

I 
I 

V 


'SPEC.ICT9311.RAU1728.H0NTEIIP.HAR17' 


(Program  is  removirg  all  duplicate  records  and  all  non_tenporary  residence) 

NCT  BRANCH 

MAINFRAME  PROCESSING: 


FIRST  PROGRAH  :     SPEC.ia9311.SRCE(DUPSEQ2) 

INPUT  FILE(S):     SPEC.ICT9311.RAWNCT.BKUP0126.PUBREAD 
OUTPUT  FILE(S):     SPEC.ICT9311 .RAWNCT.DUPS 


(40.917) 
(246  ) 


OUTPUT  FILE(S):  CAPS/CO0/PROD/EFS/RAWN1728.NONTEMP.DAT.02.MAR17     (40,   ) 


#  RECORDS:  47,057 

#  RECORDS:  86 
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SPEC. ICT9311.RAWNCT. UNIQUE 

(  LRECL:  1728.  BLKSIZE:  8M0  ) 

(Used  SORT  &  PL1  to  create  two  files:  DUPLICATE  RECORD  FILE  &  UNIQUE  RECORD  FILE) 
(Program  is  checking  duplicate  records) 


#  RECORDS:  46,971 


SECOND  PROGRAM:   SPEC.ICT9311.SRCE(FSPLIT3) 
INPUT  FILE(S):  SPEC.ICT9311 .RAWNCT.DUPS 

OUTPUT  FILE(S):  SPEC.ICT9311.RAWNCT.DUPS.DR0P 
:  SPEC. ICT9311. RAWNCT.DUPS. KEEP 
<  LRECL:  1728,  BLKSIZE:  8640  ) 


#  RECORDS:  86 

#  RECORDS:  30 

#  RECORDS:  56 
(28  DUPLICATES) 


(Program  is  spliting  households  that  could  not  be  manually  resolved  vs.  those  that  can  be  resolved.  30  vs  50 
respectively,  set  of  28  duplicates  will  be  merged  to  the  UNIQUE  File). 


THIRD  PROGBAH:  SPEC.ICT9311.SRCE(REC00E1 

INPUT  FILE(S):  SPEC.ICT9311.RAUNCT.UNIQUE 

OUTPUT  FILE(S):  SPEC.ICT9311.RAWNCT.REC0DE.HHLD6.FEB3 
.  LRECL:  1728,  BLKSIZE=86A0 


#  RECORDS:  46,971 

#  RECORDS:  46,971 


(14  records  were  recoded  using  PGH=RECOOED  ,  .  ^  ,.    u    ,n,, 

6  from  Phil's  frequency  dump,  where  PERSONID  =  '00'  but  should  have  been  '01'        „„enu,n  ,:•  ii  1/^ 
8  frSH  Lori's  memS  dated  January  21,  1994  "DOCUMENTATION  FOR  NCT  PHASE2);  records  with  PERSONID  12.13.14) 


FOURTH  PROGRAM:  fSTEPH  SPEC.ICT9311.SRCE(VLDHERGE) 
INPUT  FILE(S):  SPEC.ICT9311.RAWNCT.DUPS.KEEP 
OUTPUT  FILE(S):  SPEC.ICT9311.RAWNCT.DUPUNIQ 


#  RECORDS:  56 

#  RECORDS:  28 


CSTEP2)  SPEC.ICT9311.SRCE(VLDMERGE) 


INPUT  FILE(S):  SPEC.ICT9311.RAWNCT.DUPUNIQ 

:  SPEC.ICT9311.RAWNCT.REC00E.HHLD6.FEB3 

OUTPUT  FILE(S):  SPEC.ICT9311.RAWNCT.MERGE.DUPREC.FEB3 
(  LRECL:  1728.  BLKSIZE:  8640  ) 


#  RECORDS:  28 

#  RECORDS:  46.971 

#  RECORDS:  46,999 


(SAS  Program  is  picking  up  from  56  records(duplicate)  a  unique  record  by  using  IF>LAST>ID  function  of  SAS 
and  then  concatenating  the  .DUPUNIQ.  file  with  the  recoded  .HHLD6.FEB3.  using  DBSCOPY. 


46,999 


46,960 


FIFTH  PROGRAM  (STEP  1):  SPEC.ICT9311.SRCE(FSPLIT2) 
INPUT  FILE(S):  SPEC.ICT9311.RAWNCT.MERGE.DUPREC.FEB3 


OUTPUT  FILE(S):  SPEC.ICT9311.RAWNCT.N0HHLD.DATA 
:  SPEC.ICT9311.RAWNCT.HHLD.DATA 


#  RECORDS: 


#  RECORDS:  39 

#  RECORDS: 


(  LRECL:  1728,  BLKSIZE:  8640  ) 


(STEP  2):  SPEC.ICT9311.SRCE(FSPLIT2) 

INPUT  FILE(S):  SPEC. ICT9311 .RAWNCT.NOHHLD. DATA 


#  RECORDS:   39 
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OUTPUT  FILE(S):  SPEC. 1CT931 1 .RAWMCT.NOHHLD. KEEP  #  RECORDS:  .  2 

-   SPEC. ICT9311. RAWMCT.NOHHLD. DROP  #  RECORDS:   37 

(  LRECL:  1728.  BUSIZE:  86A0  ) 

(Program  is  spliting  PERSONID  >  '00'  &  no  data  beyond  pos.  «; 
39  records  were  found  &  dumped;  2  out  of  39  were  selected  to  keep  and  merge  with  good  file). 

fSTEP  3):  SPEC.ICT9311.SRCEtFSPLIT2) 

INPUT  FILE(S):  SPEC.ICT9311.RAWNCT.HHLD.DATA  #  RECORDS: 

^^''^^  :  SPEC. I CT9311. RAWMCT.NOHHLD. KEEP  #  RECORDS:  2 

OUTPUT  FILE(S>:  SPEC. I CT9311.RAWNCT. MERGE. DUPREC.FEB4  #  RECORDS: 

^*''^^  (  LRECL:  1728,  BLKSIZE:  8640  ) 

(Program  is  using  OBSCOPY  to  concatenate  2  above  files  together  and  produce  1  output  file) 


46.960 


46,716 


SIXTH  PROGRAM:  SPEC.I(rr9511.SRCE(ST4ST6) 

INPUT  FILE(S>:  SPEC. I CT9311.RAWNCT. MERGE. DUPREC.FEB4  #  RECORDS: 

OUTPUT  FILE(S):  SPEC.ICT9311.RAWNCT.UITH.ST4ST6.DR0P  #  RECORDS:  263 

:  SPEC. ICT9311.RAWNCT. WITHOUT. ST4ST6  #  RECORDS: 

(  LRECL:  1728,  BLKSIZE:  8640  ) 


(Program  is  spliting  the  good  file  into  2  files 
--  one  with  step4  =  3  or  step6  =  5  (246  records) 
--  one  without  step4  =  3  or  step6  =  5; 

(teflporary  residents  and  usual  place  elsewhere  in  Canada) 

NOTE:  17  RECORDS  HAD  BOTH  STEP4  =  3  &  STEP6  =  5;  THAT  ACCOUNTS  FOR  THE  DOUBLE  COUNT  IN  263  RECORDS. 


SEVENTH  PROGRAM;  SPEC.ICT9311 .SRCE(PEROO) 
INPUT  FILE(S):  SPEC.ICT9311.RAWNCT.WITH0UT.ST4ST6  #  RECORDS: 


46.716 


OUTPUT  FILE(S):  SPEC.ICT9311.RAWNCT.VLDPERID  #  RECORDS: 

40  934 

:  SPEC.ICT9311.RAWNCT.PERID00  #  RECORDS: 

(  LRECL:  1728,  BLKSIZE:  8640  ) 

(Program  is  spliting  PERSONID  ='00'  into  a  separate  file  &  keeping  the  rest  of  the  records  into  a  VLDPERID 
file  &  dunping  a  handful  of  records  to  see  the  actual  records  with  PERSONID  =  '00'.) 


EIGHTH  ROGRAM:  SPEC.ICTg311.SRCE(P0STALBL) 

INPUT  FILE(S):  SPEC. ICT9311.RAWNCT. VLDPERID  #  RECORDS: 40. 934 

OUTPUT  FILE(S):  SPEC. ICT9311.RAWMCT. VLDPERID. BLANK  #  RECORDS:  17 

:  SPEC.ICT9311.RAWMCT.VLDPERID.N0NBLK  #  RECORDS: 
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40,917 


(  LRECL:  1728.  BLKSIZE:  8640  ) 


fProaram  is  solitinq  input  file  into  2  output  files)  . 

-  one  which  has  nS  information  beyond  Postal  Code  eg.  nothing  in  Pos.51  to  next  154  bytes,  these  are  be,ng 

deleted  from  good  file. 
--  one  with  information. 


40,917 
40,915 


NINTH  ROGRAM;  SPEC.ICT9311.SRCE(DUPSEq4) 
INPUT  FILE(S):  SPEC.1CT9311 -RAWNCT.VLDPERID.NONBLK 

OUTPUT  FILE(S):  SPEC.ICT9311.RAWNCT.VLDPERID.UNIQ 
(  LRECL:  1728,  BLKSIZE:  8640  ) 


#  RECORDS: 

#  RECORDS: 


rproaram  is  removinq  2  duplicate  records  from  the  file)  -  ■  j 

Nouf ?his  stlTwas  done  after  the  file  had  gone  through  the  PREOIT.  These  2  duplicatae  records  were  picked 
up  a  week  later  when  oaaTXT  was  sent  for  Auto-Coding. 


PREDIT  PROGRAM:  FINAL  FILE  BEFORE  GOING  INTO  PREDIT 

TENTH  PROGRAM:  SPEC.ICTg311.SRCEfC0HPEDIT) 

INPUT  FILE(S):  SPEC.ICT9311.RAWNCT.VLDPERID.N0NBLK 
:  SPEC.ICT9311.SRCE(PREEDIT6) 

OUTPUT  FILE(S):  SPEC.ICT9311.NCT.PREDIT.N0NTEXT.FEB7 
Irecl:  532,  blksize:  8512 


247,197 


SPEC.ICT9311 .NCT.PREDIT.TEXT.FEB7 
Irecl:  92,   blksize:  8832 


#  RECORDS:  40,917 
«  RECORDS:  40.917 

#  RECORDS: 


(PLI     program  is  going  through  the  PREDIT  step  and  creating  2  output  files; 
(1)..  TEXT  FILE  ,  Lrecl  =  92,  Blksize  =  8832 
(2)..  NON-TEXT  FILE,  Lrecl  =  532,  Blksize  =  8512) 

FILES   BEING   PREPARED    FOR  ADTOCQDING: 


247,197 

7,022 
57,560 
12,225 
58,968 


PROGRAM  1:  SPEC.ICT9311.SRCE(S0RT4) 

INPUT  FILE(S):  SPEC.ICT9311.NCT.PREDIT.TEXT.FEB7 

LRECL  =  92,  BLKSIZE  =  8832 

OUTPUT  FILE(S):  SPEC.ICT9311.NCT.PRE0IT.TEXT.S0RTED1  (Q09T1,  Q09T2.  Q09T3) 

:  SPEC. ICT9311.NCT. PREDIT. TEXT. S0RTED2  (Q16T1.  Q16T2.  Q16T3) 

:  SPEC. ICT9311.NCT. PREDIT. TEXT.S0RTED3  (Q22T1,  Q22T2,  Q22T3) 

:  SPEC. ICT9311.NCT. PREDIT. TEXT. S0RTED4  <Q42T1-Q42T3,  Q42PC) 

:  SPEC. ICT9311.NCT. PREDIT. TEXT. SCRTED5  (Q11TX) 


#  RECORDS: 

#  RECORDS: 

#  RECORDS: 

#  RECORDS: 

#  RECORDS: 

#  RECORDS: 


6,041 
5,959 
2,105 


32,. 085 
20,890 
21,228 
20,262 


SPEC. ICT9311.NCT.PREDIT. TEXT. S0RTED6  (Q12TX) 

SPEC. I CT9311.NCT.PRED IT. TEXT. SORTED/  (Q13TX) 

SPEC. ICT9311. NOT. PREDIT. TEXT. S0RTED8  (Q18TX) 
SPEC. ICT9311.NCT.PREDIT. TEXT. S0RTED9  (Q19TX) 
SPEC. I CT9311.NCT. PREDIT. TEXT. SORTED 10  (Q24TX) 
SPEC. ICT9311.NCT. PREDIT. TEXT. S0RTED11  (Q41TX) 
SPEC. ICT9311.NCT. PREDIT. TEXT. S0RTED12  (Q02TX) 

SPEC. ICT9311.NCT. PREDIT. TEXT. S0RTED13  (Q34TX) 

SPEC. ICT9311.NCT. PREDIT. TEXT. S0RTED14  (Q35TX) 

SPEC. I CT9311.NCT. PREDIT. TEXT. SORTED 15  (Q37TX) 

SPEC. I CT9311.NCT. PREDIT. TEXT. SORTED 16  (Q38TX) 

SPEC. ICT9311.NCT. PREDIT. TEXT. S0RTED17  (Q43TX) 
SPEC. ICT9311.NCT. PREDIT. TEXT. S0RTED18  (Q46TA-Q46TK) 


(Using  SORT  to  create  18  output  files  according  to  the  required  fields  from  the  input  file) 
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#  RECORDS: 

#  RECORDS: 

#  RECORDS:  670 

#  RECORDS:  588 

#  RECORDS:  138 

#  RECORDS:  447 

#  RECORDS:  613 

#  RECORDS: 

#  RECORDS: 

#  RECORDS: 

#  RECORDS: 

#  RECORDS:  396 

#  RECORDS: 


SUBSEQUEMT  PROGRAHCS)  TO  CREATE  TEXT  FILES  FOR  AUTOCOOING 


SPLIT  FOR  Q09  TB(T  {KtlOULEDGE  OF  LAMGUAffi) 

INPUT:  SPEC. ICT9311.NCT. PREDIT. TEXT. S0RTED1 
SPEC. ICT9311.NCTAC.LANQ09. FINAL. ESS 

OUTPUT(I):  SPEC.ICT9311.PF.NCT.Q09TXT.WITHAC 
Irecl  =  99,  blksize  =  8811 

(2):  SPEC.ICT9311.PF.NCT.Q09TXT.FORAC 
Lrecl  =  92,  Blksize  =  8832 
I 
I 


#  RECORDS:  7,022 

#  RECORDS:  1,028 

#  RECORDS:  875 


#  RECORDS:  6,147 


I 
(1) 
SPEC.ICT9311.PF.NCT.Q09TX1.FORAC 

(#  RECORDS:  5,385) 


(2) 

SPEC.ICT9311.PF.NCT.Q09TX2.FORAC 

(#  RECORDS:  639) 


I 
(3) 
SPEC.ICT9311.PF.NCT.Q09TX3.FORAC 
(#  RECORDS:  123) 


SPLIT  FOR  Q11  TEXT  f MOTHER  TOMGUE) 

INPUT:  SPEC. ICT9311.NCT. PREDIT. TEXT. S0RTE05 
SPEC. ICT9311.NCTAC.LANQ11. FINAL. ESS 

OUTPUT(I):  SPEC.ICT9311.PF.NCT.Q11TXT.WITHAC 
lrecl  =  99,  blksize  =  8811 

(2):  SPEC.ICT9311.PF.NCT.Q11TXT.F0RAC 
lrecl  =  92,  blksize  =  8832 

SPLIT  FOR  Q12  TEXT  CPLACE  OF  BIRTH) 

I NPUT :  SPEC . I CT931 1 . NCT . PRED I T . TEXT . S0RTED6 
SPEC. ICT9311.NCTAC.PCTQ12. FINAL. ESS 

OUTPUT(I):  SPEC. ICT9311.PF. NCT. Q12TXT.WITHAC 
lrecl  =  99,  blksize  =  8811 

(2):  SPEC. ICT9311.PF. NCT. Q12TXT.F0RAC 
lrecl  =  92,  blksize  =  8832 


#  RECORDS:  6,041 

#  RECORDS:  883 

#  RECORDS:  756 


#  RECORDS:  5,285 


#  RECORDS:  5,959 

#  RECORDS:  950 

#  RECORDS:  808 


#  RECORDS:  5,151 
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SPLIT  FOR  Q13  TEXT  fCITIZEMSHIP) 

! NPUT :  SPEC . I CT931 1 . NCT . PRED I T . TEXT . SORTED? 
SPEC. ICT9311.NCTAC.PCTQ13. FINAL. ESS 

OUTPUT(I):   SPEC. ICT9311.PF. NCT. Q13TXT.WITHAC 
Irecl  =  99,  blksize  =  8811 

(2):  SPEC. ICT9311.PF. NCT .Q13TXT.F0RAC 
Irecl  =  92,  blksize  =  8832 


#  RECORDS:  2,105 

#  RECORDS:  299 

#  RECORDS:  237 

#  RECORDS:  1,868 


SPLIT  FOR  Q16  TFXT  fETHMIC  ORIGIII) 

INPUT:  SPEC. ICT9311. NCT. PREDIT. TEXT. S0RTED2 
SPEC. ICT9311.NCTAC.ET0Q16.FINAL. ESS 

OUTPUT(I):  SPEC.ICT9311.PF.NCT.Q16TXT.WITHAC 
Irecl  =  99,  blksize  =  8811 

(2):  SPEC.ICT9311.PF.NCT.Q16TXT.F0RAC 
Irecl  =  92,  blksize  =  8832 


#  RECORDS:  57,560 

#  RECORDS:  13,434 

#  RECORDS:  11,869 


#  RECORDS:  45,691 


I 
(1) 
SPEC.ICT9311.PF.NCT.Q16TX1.F0RAC 

(#  RECORDS:  31,338) 


I 
(2) 
SPEC.ICT9311.PF.NCT.Q16TX2.F0RAC 
<#  RECORDS:  10,608) 


I 
(3) 
SPEC.ICT9311.PF.NCT.Q16TX3.F0RAC 
(#  RECORDS:  3,745) 


SPLIT  FOR  Q18  TEXT  CRACE) 

INPUT:  SPEC. ICT9311. NCT. PREDIT. TEXT.S0RTED8 
SPEC . I CT931 1 . MCTAC . ET0Q1 8 . F I NAL . ESS 

OUTPUT(I):  SPEC.ICT9311.PF.NCT.Q18TXT.UITHAC 
Irecl  =  99,  blksize  =  8811 

(2):  SPEC.ICT9311.PF.NCT.Q18TXT.F0RAC 
Irecl  =  92,  blksize  =  8832 


#  RECORDS:  670 

#  RECORDS:  94 

#  RECORDS:  75 


#  RECORDS:  595 


SPLIT  FOR  Q19  TEXT  CIWDIAW  BAND) 

INPUT:  SPEC. ICT9311. NCT. PREDIT. TEXT. SORTE09 
SPEC. ICT9311.NCTAC.INDQ19. FINAL. ESS 

OUTPUT(I):  SPEC.ICT9311.PF.NCT.Q19TXT.WITHAC 
Irecl  =  99,  blksize  =  8811 

(2):  SPEC. ICT9311.PF. NCT. 019TXT.F0RAC 
Irecl  =  92,  blksize  =  8832 


#  RECORDS:  588 

#  RECORDS:  46 

#  RECORDS:  37 


#  RECORDS:  551 
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SPLIT  FOR  Q22  TEXT  (MOBILITY  mSIDE/OUTSIDE  CANADA 

(40,917) 
(A0.917) 


INPUT:  SPEC.1CT9311.RAWNCT.VLDPEID.N0NBLK 

OUTPUT:  SPEC.ICT9311.NCT.Q22TXT 

I 

I 


SPEC.ICT9311.NCT.Q22TXTIC 
(40,917) 


SPEC. ICT9311 .NCT.Q22TXTOC 
(40,917) 


SPEC.ICT9311.NCT.Q22TXTIC.NONBLK 
(5,763) 


SPEC.1CT9311.NCT.Q22TXTIC. BLANKS 
(35,154) 


I 
SPEC.ICT9311.NCT.Q22TXT0C.BLANKS 
(39,707) 
INPUT:  SPEC.ICT9311.Q22TXTIC.NONBLK 
OUTPUT:  SPEC.ICT9311.Q22TXTIC.UNIQUE 

INPUT:  SPEC.ICT9311.Q22TXTIC.UNIQUE 


SPEC . I CT931 1 . NCT .Q22TXT0C. NONBLK 


(5,763) 
(5,761) 


(5,761) 
SPEC.lcT93ii.NCTAC.M5PQ22T1.FINAL.ESS  (1,540) 


OUTPUT:  SPEC.ICT9311.PF.NCT.Q22TXTIC.WITHAC 
Irecl  =  104,  blksize  =  8840 

SPEC.1CT9311.PF.NCT.Q22TXTIC.F0RAC 
Irecl  =  97,  blksize  =  8827 


(892) 
(4,869) 

INPUT:  $PEC.ICT9311.Q22TXT0C.N0NBLK 

OUTPUT :  SPEC . I CT931 1 . Q22TXT0C . UN I QUE 


(1,210) 


(1,210) 
(1,210) 


INPUT:  SPEC.ICT9311.Q22TXT0C.UNIQUE         (1,210) 
SPEC. ICT9311.NCTAC.PCTQ22T3. FINAL. ESS  (179) 


OUTPUT:  SPEC.ICT9311.PF.NCT.Q22TXTOC.WITHAC    (138) 
Irecl  =  99,  blksize  =  8811 

SPEC.ICT9311.PF.NCT.Q22TXT0C.F0RAC     (1,072) 
Irecl  =  92,  blksize  =  8832 


SPLIT  FOR  Q24  TEXT  (LANGUAGE  OF  EDUCATIOM) 

INPUT:  SPEC.ICT9311.NCT.PREDIT.TEXT.SORTED10 
SPEC. ICT9311.NCTAC.LANQ24. FINAL. ESS 

OUTPUT(I):  SPEC.ICT9311.PF.NCT.Q24TXT.WITHAC 
Irecl  =  99,  blksize  =  8811 

(2):  SPEC.ICT9311.PF.NCT.Q24TXT.FORAC 
Irecl  =  92,  blksize  =  8832 


#  RECORDS:  138 

#  RECORDS:  59 

#  RECORDS:  25 


#  RECORDS:  113 
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SPLIT  FOR  QA1  TB(T  CLAWGUAGE  OF  UORIC) 

INPUT:  SPEC. 1CT9311.NCT.PRE0IT. TEXT. S0RTE011 
SPEC . I CT931 1 . NCTAC . LANQ41 . F I NAL . ESS 

OUTPUT(I):  SPEC.ICT9311.PF.NCT.Q41TXT.WITHAC 
Irecl  =  99,  blksize  =  8811 

(2):  SPEC.ICT9311.PF.NCT.Q41TXT.F0RAC 
Irecl  =  92,  blksize  =  8832 


#  RECORDS:  447 

#  RECORDS:  78 

#  RECORDS:  52 


#  RECORDS:  395 


SPLIT  FOR  042  TEXT  (PLACE  OF  WORK) 


INPUT:  SPEC.ICT9311 

OUTPUT:  SPEC.ICT9311 

INPUT:  SPEC.1CT9311 

OUTPUT:  SPEC.ICT9311 

:  SPEC.ICT9311 

INPUT:  SPEC.ICT9311 

:  SPEC.ICT9311 

OUTPUT:  SPEC.ICT9311 

Irecl  =  163, 

SPEC.ICT9311 
Irecl  =  163, 


.NCT.VLDPERID.UNIQUE 

.NCT.Q42TXT 

.NCT.Q42TXT 
.NCT.Q42TXT.N0NBLK 
.NCT.Q42TXT. BLANKS 

.NCT.Q42TXT.N0NBLK 
.PF.RAWPH1 .Q42TXT.N0NBLK 
.PF.NCT.Q12TXT.WITH0AC 
blksize  =  8802 

.PF.NCT.Q12TXT.F0RAC 
blksize  =  8802 


#  RECORDS:  17,177 

#  RECORDS:   4,058 

#  RECORDS:   1,425 


#  RECORDS:  15,752 


DNIX   PROCESSING   FOR  NCT  AFTER   PREDIT 
"SPEC.ICT9311.HCT.PREDIT.H0MTEXT.FEB7*  (40,917) 

DOWNLOADED  TO  UNIX 
"CAPS/C0D/STEVEHS/HCT/MCT.PREDIT.EXCLQ46"   (40,917) 

IJNIXPROCFSSTNG  fin  SAS) 

NCT  FLOW  OF  FILES  AFTERPREPrr 


I NPUT :   . . / . . /STEVENS/NCT/NCT . PRED I T . EXCLQ46 
+ 
../../PRAKNEE/YOB IMPUT.DAT  j 

Pqm  Function: 

merging  Year  of  Birth  and 
imputation  flag  for  year  of  birth 
from  the  274  records  file 

created  by  Matthew  Briggs,  SSMD  ^ 

(who  manually  imputed  missing  y.o.b.)        i 

OUTPUT:   ../../PRAKNEE/YOBIMP.DAT 


. / . . /praknee/Yobi  mput . pgm 
./. ./praknee/Yobimput. log 
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INPUT:   ../../PRAKNEE/YOBIMP.DAT 
+ 
. ./. ./PRAKNEE/SEXMSG.DAT 

Pqn  Function: 

merging  Sex  and  input ed 
sex  flag  from  the  file 
created  by  Phil  (who  manually 
imputed  missing  SEX) 

OUTPUT:   ../../PRAKNEE/SEXFLG.DAT 


./../praknee/Sexf IgZ.pgm 
./. ./praknee/sexf lg2. log 


INPUT:   ../../PRAKNEE/SEXFLG.DAT 

Pan  Function: 

Receding  Assignment  #  for 
certain  PSUs  that  belong  to 
special  population  vs  labour 
force  sample. 

OUTPUT:   ../../PRAKNEE/RECDASS.DAT 


./. ./praknee/recdass.pgm 
./. ./praknee/recdass. log 


I NPUT :   . . / . . /PRAKNEE/RECDASS . DAT 

Paw  Function: 

sas  program  to  exclude 
duplicate  records 

OUTPUT:   ../../PRAKNEE/EXCUOUP.OAT 


./. ,/praknee/excldup.pgm 
./. ./praknee/excldup. log 


. ./. ./PRAKNEE/EXCLDUP.DAT 

Pom  Function: 

4  records  had  sex  missing 
after  Phil's  recoded  sex  pgm 
was  completed,  therefore 
sex  for  those  4  recoded  in  this 
program. 

../../PRAKNEE/RECDSEX. DAT- 


renamed 


. / . . /PROD/NCT/RECDSX . PRE532 .DAT . 00 . FEB24 


Program  function: 
derived  age  is 
created  in  this 
program  from  date 


DVAGE2.PGM 
0VAGE2.LOG 
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of  birth  by  I     DVAGE2.0UT 

Christian  Branconnier,  COD.      j 
Derived  variable  is  j 

DVAGE2  (pos.670,2)  | 

V 
. / . ./PR00/NCT/DVAGE2 .0VS953 .OAT . 01 . FEB24 


./../PRO0/NCT/DVAGE2.DVS953.DAT.01.FEB24  (40,915) 


DVLANG.PGM 
DVLANG.LOG 
DVLANG.OUT 


Program  function: 

derived  language 

variable  are  created 

here  from  Q9 

KOL  (672,2)-  knowledge  of  language 

HLN  (674,1)-  hoone  language 

MTN  (675,2)-  mother  tongue 

LGEDUC(677, 1 )  -  language  of  education 

LGWORK  (678,1)-  language  of  work 

OL  (679,1)  -  knowledge  of  official 

language 
NOL  (680,1)-  knowledge  of  non-official 

language 
0LN0L(681,1)-knowledge  of  official/ 

non-official  language 


. / . . /PROO/NCT/DVLANG . D VS953 . DAT . 02 . FEB28  (40,915 


../../PROO/NCT/DVLANG.DVS953.DAT.02.FEB28  (40,915) 

+ 
../../PR00/MCT/ST4ST6.DAT  (263) 


Program  fmction: 
created  data  file  with  263  rec.  & 
3  variables-(hhldid,step4,step6) 
This  program  is  therefore 
removing  households  from  the 
DVLANG  file  that  have  temporary 
residences  through  merge  process 
by  eliminating  those  records 
that  were  in  the  st4st5  data  file. 


NONTEMP.PGM 
N0NTEMP.LOG 
NONTEMP.OUT 


../../PROO/NCT/NONTEMP.DVS953.DAT.03.MAR16  (40,662) 


r./../PROO/NCT/NONTEMP. DVS953.DAT. 03. MAR16  (40,662) 


Program  function: 

Q46  (income  question)  and 
Multiple  error  flags  for  all 
related  questions  have  been 
created  here  in  this  program 


Q46MEF.PGM.MAR18 
Q46MEF.LOG. MARIS 
Q46MEF. OUT. MARIS 


. ./. ./PR0D/NCT/Q46MEF. DVS953.DAT. 04. MARIS  (40,662) 
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~:./. ./PR00/NCT/Q46MEF.DVS953.DAT.04.MAR18  (A0,662) 
. ./. ./PRO0/EFS/DVLANG.DVS953.DAT.04.MAR18  (9,986) 

Program  fuiction: 

creating  a  flag  (EFSFLG)  in 
the  NCT  file  for  those 
records  that  are  in  the  EFS 
file  (pos.669,1) 

../../PRO0/NCT/EFSFLG.0VS953.DAT.05.MAR18  (40,662) 


EFSFLG. PGM. MAR18 
EFSFLG. LOG. MAR18 
EFSFLG. OUT. MARIS 


fT./. ./PROO/NCT/EFSFLG.DVS953.DAT.05.MAR18  (40,662) 


11 


Program  function: 

This  program  is  linking 
codes  from  autocoding 
back  in  the  NCT  file. 


CODLNK1.PGM.MAR30 
CO0LNK1.LOG.HAR30 
CODLNK1.0UT.MAR30 


V 
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./../PROO/NCT/COOLNK. DVS953.DAT. 06. MAR30  (40,662) 


". ./. ./PR0O/NCT/CODLNK.DVS953.DAT.06.MAR30  (40,662) 

Proaran  function-  I  CLINKEFS.PGM.MAR30 

7?nMng^eg?S  codes  !         CLINKEFS.LOG.MAR30 

that  were  not  sent  for  |         CLINKEFS.OUT.MAR30 

autocoding,  for  they  already  j 
had  a  code  (because  the  text! 
in  the  NCT  file  Mas  the  same     ; 
as  in  the  EFS  file)  | 

V 
../../PRO0/NCT/CLINKEFS.DVS953.DAT.07.MAR30  (40,662) 


■~T./../PROO/NCT/CLINKEFS.DVS953.0AT.07.MAR30  (40,662) 
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Program  function: 

linking  language  and  ethnic 
recodes  and  multiple  codes 
to  the  above  file. 

. ./. ./PR0O/NCT/CO0LNK2.DVS953.DAT.08.MAR30  (40,662) 


COOLNK2.PGM.MAR30 
COOLNK2.LOG.MAR30 
COOLNK2.0UT.MAR30 


V 
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T./. ./PROO/NCT/COOLNK2.DVS953.0AT.08.MAR30  (40,662) 

Program  fmction:  !         ASSPSU.PGM.HAR30 

receding  Assignment  &  PSU  1    ASSPSU.LOG.MAR30 

according  to  different  !    ASSPSU.OUT.MAR30 

rotation  group  (Lori's  request)  , 

(pos.12,5)  &  (pos.8,1)  I 

. ./. ./PROD/NCT/ASSPSU. DVS953.DAT. 09. MAR30  (40,662) 
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~~..l.  ./PROO/NCT/ASSPSU. DVS953.DAT. 09. MAR30  (40,662) 

Program  function:  |  LB FORCE. PGM. MAR30 

15 i   creating  labour  market  j  LB FORCE. LOG. MAR30 

derived  variables  from  j  LB FORCE. OUT. MAR30 

pos  (790  to  804)  I 

I 

V 
../../PROO/NCT/LBFORCE. DVS953.DAT. 10. MAR30  (40,662) 


{      r./../PROD/NCT/LBFORCE.DVS953.DAT.10.MAR30  (40,662) 

j   Program  fmction:  !  LBF0RCE.WGTED.PGM.HAR30 

16         weights  are  added  to  the  j  LB FORCE. WGTED. LOG. MAR30 

Labour  force  file  in  this  j  LB FORCE. WGTED. CUT. MAR30 

I       file  (pos.925,8).  i 

i  i 

../../PROO/NCT/LBFORCE.DVS953.WEIGHTED.DAT.11.MAR30  (40,662) 


} — :./../PROD/NCT/LBFORCE.DVS953. UEIGHTEO.DAT. 11. MAR30   (40,662) 

Pew  Function:  |  .    ,  ..u    -     r».<  v 

•^■j\  j       (file  produced  by  Norm  Crampton  on  mainframe,  to  create  ethnic  Dvs) 

V 

}   ../.. /PROO/NCT/ETHDVS. DVS953.DAT. 12.APR22  (40,662) 
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T./../PR00/NCT/ETHDVS.DVS953.DAT.12.APR22  (40,662) 


FIXQ46.PGM.MAY02 
FIXQ46.LOG.MAY02 
FIXQ46.0UT.MAY02 
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Pan  Function: 

Picking  Q46AAmt  from  the  raw 
file  (length  20  bytes)  for 
in  the  Predit  only  19  bytes  of 
Q46AAmt  were  picked  up  and  the 
20th  byte  was  garbage,  in  order  to 
run  Q46MEF.PGH  again  just  for 
Q46AAmt  in  the  next  step. 

V 

../../PR00/NCT/FIXQ46.DVS953.DAT.13.MAY02  (40,662) 


~~:./../PROO/NCT/FIXQ46.DVS953.DAT.13.MAY02  (40,662) 

Pan  Function:  | 

Rerunning  Q46MEF.PGM  for  |  Q46MEF.REV.PGH 

Q46AAmt  only  and  for  |  CI46MEF.REV.LOG 

related  multiple  flags.  I  Q46MEF.REV.0UT 

V 
../../PRO0/NCT/Q46MEF.0VS953.DAT.14.MAY02  (40,662) 


j~7./../PROO/NCT/Q46MEF. DVS953.DAT. 14. MARY02  (40,662) 

I  .  I 

1   Pgra  Fmction:  i 

Creating  income  derived  i        INCOME.PGM.MAY02 
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20'       variables:   wages,    investment  income      |  INCOME. LOG. HAY02 

UIC     total    income,    etc.  |  INCOME.OUT.MAY02 

I  V 

j        ./../PRO0/NCT/INCOME.DVS953.DAT.15.MAY02  (40,662) 


■~:./../PRO0/NCT/INCOHE.DVS953.DAT.15.MAY02  (40,662) 
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Ptm  FuTCtion:  i 

Fixing  language  DVs  and  adding  j       FIX.OVLANG.PGH 

the  AGEGP  (pos.666,2)  and  SEX  FIX.DVLAMG.LOG 

(pos.668.1)  variables.  FIX.DVLANG.OUT 

(fixed  by  Phil)  i 

V 
. ./. ./PR00/NCT/REVDVLANG.DVS953.DAT.15A.MAY0A  (40,662) 


"../../PROO/NCT/REVOVLANG.DVS953.DAT.15A.MAY04  (40,662) 

P«in  Function: 

Cleaning  income  derived  variables 
like  wages,  self  emplyment,  UIC, 
with  '  '  instead  of  '.'  and 
Spiliting  the  file  into  2  parts 
the  Labour  force  file  and  the 
Special  Population  file. 


INCOME. FIX1. PGM 
1NC0ME.FIX1.LOG 
INCOME. F 1X1 .OUT 


../../PR00/IICT/DVS953.LFSAMP.DAT.16.MAY04  (32,696) 

../../PRO0/NCT/PART1.MAY04  (10,000) 

. ./. ./PROO/NCT/PART2.MAY04  (10,000) 

. . / . . /PR00/NCT/PART3 . HAY04  ( 1 0 , 000 ) 

../../PR00/NCT/PART4.MAY04  (  2,696) 


. ./.  ./PR0D/KCT/SPECP0P.DVS953.DAT.17.MAY04  (7,966) 
../../PROO/NCT/PART5.MAY04  (  7,966) 
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LABOUR  FORCE  FILE 

../../PR00/NCT/DVS953.LFSAMP.0AT.16.MAY04  (32,696) 
RENAMED  TO 

../../PR00/NCT/0VS953. LFSAMP.DAT. 14. APR08  (32,696) 
(in  order  to  stick  with  the  file  name  SM  people  had  already  been  told  to  use) 

UPLOADED  TO  MAINFRAME  AS 

INPUT:    "SPEC.ICT9311.NCT.LFSAMP.APR14.PUBREAD" 
(  recoding  the  HLDSIZE  from  blank  to  '0') 
I 

V 
OUTPUT:   "SPEC. ICT9311.NCT.LFSAMP.HHSIZE. FIX" 

INPUT:    "SPEC. ICT9311.NCT.LFSAMP.HHSIZE. FIX" 

(  recoding  Q46,  WAGES,  SELF_EMP,  &  INVEST_INC  ) 
I 

V 
OUTPUT:   "SPEC. I CT9311.NCT.LFSAMP.REC0DE. WAGES" 
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RENAMED  ON  MAINFRAME  TO 
■SPEC.ICT9311.MCT!LFSAMP-APRl4.PtJBREAD'' 

DOWNLOADED  TO  UNIX  AS 
../../PR00/NCT/DVS953. LFSAMP.DAT. 16. MAY16  (32,696) 

RENAMED  TO 

■  ■/■./PR00/MCT/DVS953.LFSAMP.DAT.14.APR08  C32  696)  ,  ,^  »„  ,.e„N 

(in  order  to  stick  with  the  tile  name  SM  people  had  already  been  told  to  use) 


NOTE:  PSU  RECOOE  WAS  DONE  ON  LFSAMP  FILE  BUT  NOTHING  WAS 
RECOOED.  FOR  THERE  WAS  NO  PSU#  ='85087'  IN  THE  FILE 
TO  BE  RECOOED.  HOWEVER,  THE  STEP  WAS  DONE  IN  ORDER  TO 
CHECK  ITS  EXISTENCE  AND  THERFORE  DOCUMENTED  IN 
REVPSU.PGM/REVPSU.LOG/REVPSU.OUT  BUT  WAS  NOT  CARRIED 
OUT  (PROCESSED). 
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../../PROD/NCT/DVS953. LFSAMP. DAT. U.APR08  (32,696) 
Pom  Function:       j 


j       LABFRCE.DVCHECK.PGM 


i       LABFRCE.L0G.MAY19 
V       LABFRCE.0UT.MAY19 
../../PR0D/NCT/LABFRCE.DV.REVISED.DAT.17.HAY19  (32,696)- 


MOVEO  TO 
I 


../../0LDPR00/NCT/LABFRCE.DV.REVISED,DAT.17.MAY19.Z  (32,696) 
RENAMED  TO 
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■  ■/■■/PR0O/MCT/DVS953.LFSAHP-n>T.U  APR08  t32  696)     <------- 

(still  sticking  with  the  file  name  SM  people  naa  already  been  told  to  use) 


SPECIAL   POPULATION  FILE 

../../PROD/NCT/SPECPOP.DVS953.DAT.17.MAY04  (7,966) 
RENAMED  TO 

../../PROD/NCT/SPECPOP.DVS953.DAT.15.APR14  (7,966)  »  ,^  »„  „«•, 

(in  order  to  stick  with  the  file  name  SM  people  had  already  been  told  to  use) 

UPLOADED  TO  MAINFRAME  AS 

INPUT:    "SPEC.ICT9311.NCT.SPECP0P.APR14.PUBREAD" 
(  receding  the  HLDSIZE  from  blank  to  '0') 


V  . 
OUTPUT :   "SPEC . I CT931 1 . NCT . SPECPOP . HHS I ZE . F IX" 


INPUT:    "SPEC. ICT9311. NCT. SPECPOP. HHSIZE. FIX" 

(  recoding  046,  WAGES,  SELF_EMP,  &  INVEST_INC  ) 
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OUTPUT :   "SPEC . I CT931 1 . NCT . SPECPOP . RECODE . WAGES" 
I 

RENAMED  ON  MAINFRAME  TO 

■SPEC.ICTg511.NCT!sPECPOP.APR14.PUBREAD" 

after'  deleting  the  one  created  before  under  the  same  name 
(in  order  to  stick  with  the  file  name  SM  people  had  already  been  told  to  use) 

DOWNLOADED  TO  UNIX  AS 
../../PROO/NCT/SPECPOP. DVS953.DAT. 17.MAY16  (7,966) 
RENAMED  TO 

. ■/■./PRa)/NCT/SPECP0P.PVS953.DAT.15.APR14  (7.966) 

(still  sticking  with  the  tile  name  SM  people  had  already  been  told  to  use) 
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../../PR00/MCT/SPECP0P.DVS953.DAT.15.APR14  (7,966) 

Program  function:   j 

j  REVPSUSP.PGM 
j  REVPSUSP.LOG 
V       REVPSUSP.OUT 

../../PROD/NCT/REVPSU. SPECPOP. DAT. 17.MAY18  (7,966)- 
I 
I 

MOVED  TO 
I 


../../OLDPROO/NCT/REVPSU. SPECPOP.DAT. 17.MAY18  (7,966) 


RENAMED  TO 
I 


. ./■./PR0D/HCT/SPECP0P.DVS953.DAT.15.APR14  (7.966) 


../../PR00/NCT/SPECP0P.DVS953.DAT.15.APR14  (7,966) 


27 


Program  fmction;     |  SPECPOP.DVCHECK.PGM 

Corrections  to     j  SPECPOP. LOG, MAY20 

LF  DVs  for  Sandra   j  SPECPOP. OUT. MAY20 

Swain.  Pgm  by  Phil  j 

V 

../../prod/nct/specpop. dv.revised.dat. 18. may20  (7,966)- 
moved'to 


../../OLDPROO/NCT/SPECPOP. DV.REVISED.DAT. 18. MAY20  (7,966) 
I 

RENAMED  TO 
I 
I 

/PR0D/HCT/SPECP0P.DVS953.DAT.15.APR14  (7.966)     < 


oos 
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